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Background: In educational research, online survey has 
become one of the most popular methods of data collection. 
Academic researchers, including faculty and students, expect 
and require a good response rate to their research projects 
for reliable results. 


Purpose: In this paper, the authors examine a wide range of 
factors related to survey response rates in academic research. 
Examples include email checking habits, survey design, and 
attitudes toward research. 


Setting: An online survey environment 
Intervention: Not applicable. 


Research Design: A cross-sectional quantitative research 
method was used to analyze the factors that influence 
participants’ email survey response rate. Data were collected 
at a single point in time. The authors did not directly measure 
changes that come over time in this study. 
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Data Collection and Analysis: After receiving the Institutional 
Research Board’s approval, the researchers distributed the 
survey via the American Educational Research Association 
(AERA) Graduate Student Discussion List subscribers. A sample 
of 454 responses was used in the final analysis-- with a 78.9 % 
response rate. The authors used descriptive statistics 
(percentage, average mean) and inferential statistics (chi- 
square and correlations) to report the data analysis and 
findings. 


Findings: Results indicated that research survey response rate 
was highly influenced by interests of participants, survey 
structure, communication methods, and assurance of privacy 
and confidentiality. The findings also suggested that male 
participants were more likely to respond to surveys if they 
received a reminder, and older participants were more likely 
to respond if they were promised a reward. 


Keywords: academic research; education graduate students; online surveys; postal surveys; survey response rates 


Survey Invitation 


Figure 1. Factors influencing survey response rates 


Introduction 


In educational research, the online survey has 
become a popular method of data collection. 
Academic researchers including faculty and 
students are more prone to use online surveys due 
to quick responses. Utilizing surveys, a favorable 
response rate is required to obtain satisfactory 
results for the research project. Online surveys 
have many advantages as well as disadvantages. 
One advantage scholars have reported is that the 
online surveys yield significantly higher response 
rates than the paper surveys (Koundinya, Klink, 
Deming, Meyers, & Erb, 2016; Liu & Wronski, 
2017; Schonlau, Fricker, & Elliott, 2002). 

One of the major issues with online surveys is 
having an updated and accurate email address list 
for potential participants. Based on the authors’ 
experiences, many people active in education tend 
to have more than one email addresses, often 
times including an email address that may be 
rarely checked. Silva and Durante (2014) reasoned 
that a majority of people use the Internet for 
entertainment and recreation, which makes them 
discount research survey participation requests, 
resulting in a low response rate. Still, Silva and 
Durante (2014) asserted that the Internet holds 
great potential for future research. 

In the last three decades, online surveys have 
become the predominant method of eliciting 
participation in academic research for its ease, 
quick response, and low cost. Educational scholars 
have noticed a decline in the response rate of 
online surveys compared to postal surveys (Fan & 
Yan, 2010; Fosnacht, Sarraf, Howe, & Peck, 2017; 
Roberts & Allen, 2015; Shannon & Bradshaw, 
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Sub-factors 

Survey 
* Email checking habit Response 
* Length of survey Rate 


* Professionalism 
* Survey structure 
* Interest 


2002; Sheehan, 2001). Based on our personal 
experience of supervising doctoral students in 
their graduate research projects, students are not 
willing to use postal mail for its cost compared to 
e-mail surveys. Some survey platforms such as 
Qualtrics and Survey Monkey allow researchers to 
easily transfer the data to sophisticated statistical 
analysis programs. Online surveys also record the 
number of deliverable e-mails keeping an accurate 
measure of the sample size. While, others have a 
feature to track the respondents’ IP addresses, so 
they do not send follow up reminders to those who 
already completed the survey. Still, we have 
witnessed a remarkable decrease in the response 
rate of e-mail surveys in the last decade. 

A low response rate of online surveys has been 
a concern for many researchers in the last few 
years; the response rate for web surveys is 
estimated to be 11% lower than other survey 
modes (Yan & Fan, 2010). In this study, we 
examined the factors that influence education 
graduate students’ responses to online surveys 
such as email checking habits, survey design, and 
attitudes toward research. 


Theoretical Framework 


Dillman’s (2007) social exchange theory contends 
that humans’ behavior is motivated by the 
response they expect to elicit. In other words, 
survey response rates depend on a combination of 
factors including reward, trust, and costs. All of 
these factors affect the likelihood that individuals 
will respond to surveys. Elaborating on the three 
elements that proffered, this study hypothesized 
that ease and low cost (represented in the time 
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taken to fill the survey by the respondents); origin 
or sponsor of the survey, structure and length of 
the survey, assurance of confidentiality, and the 
use of pre-notification and reminders (all 
portraying professionalism on the part of the 
researcher); and the use of rewards and/or 
incentives as well as interest in the focus of the 
research will be identified as influential factors in 
increasing web survey response rates. 


Literature Review 


Online surveys have many advantages over 
traditional postal surveys, including a reduction in 
cost and ease of analysis (Andrews, Nonnecke, & 
Preece, 2003; McPeake, Bateson, & O'Neill, 2014). 
For example, Sheehan and McMillan (1999) 
compared e-mail to mail surveys and found that e- 
mail surveys took an average of 7.6 days while mail 
surveys took an average of 11. 8 days to return. The 
cost of e-mail surveys they estimated to be 5-12% 
of the cost of mail surveys. In another study 
among college faculty members, Shannon and 
Bradshaw (2002) found that electronic surveys are 
cheaper and faster than postal surveys but the 
response rate was not as high as that generated by 
mail surveys. They also argued that online surveys 
have drawbacks such as selection bias and poor 
response rates. Uhlig, Seitz, Eter, Promesberger, 
and Busse (2014) found that Internet-based 
surveys are time and cost efficient for populations 
larger than 300. On the other hand, paper or mail 
surveys can be more appropriate for smaller 
populations. 

Online surveys also have distinctive features 
related to design, distribution and evaluation of 
data. The relevance of the topic to the responders 
is also a major factor in the response rate for any 
survey (Dillman, 2007). The length of survey is 
another significant factor in response rate (Liu & 
Wronski, 2017; Porter, 2004b). Based on 25,080 
real-world web surveys, Liu and Wronski (2017) 
found a negative relationship between completion 
rate and survey length and question difficulty. 
They also suggested that surveys without progress 
bars have higher completion rates than surveys 
with progress bars. McPeake et al. (2014) 
suggested keeping the survey as short as possible. 
Two early studies found that surveys which take 
thirteen minutes or less have higher response rates 
(Asiu, Antone, & Fultz, 1998; Handwreck, Carson, 
& Blackwell, 2000). How the surveys are designed 
and presented to the target population is another 
factor that influences the response rate (Crawford, 
McCabe, & Pope, 2005; Dillman, & Smyth, 2007). 
Fan and Yan (2010) established five survey 
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delivery elements affecting survey response rate. 
These elements are: sample; delivery mode; 
invitation design; the use of pre-notification and 
reminders; and the use of incentives. 

Targeting a population that has access to the 
Internet and an interest in the survey topic is vital. 
Student and employee populations are more likely 
to respond to surveys than the general population 
(Shih & Fan, 2008; Vance, 2011). Yet, another 
study showed that students, especially at public 
schools, have low response rate to surveys 
(Perkins, 2011). Similarly, Margo, Prybtok and 
Ryan (2015) found a significant difference in 
response rates between participants who were 
offered extra credit and those who were not. 

In academic research, personalization of 
invitations using personal greetings, titles, and 
addresses significantly increased response rate 
(Heerwegh, Vanhove, Matthijs, & Loosveldt, 2003; 
Joinson, Woodley, & Reips, 2007). Asking for help 
from responders is influential in increasing 
response rate (Groves, Cialdini, & Couper, 1992; 
Porter, 2004b). Petrovéi¢é, Petri¢, and Lozar 
Manfreda (2016) also found a plea for help was 
effective for eliciting responses in email 
invitations. Porter (2004b) found that people were 
more likely to respond to survey requests from 
authority figures or if they were addressed as a 
part of a select group chosen to fill out the survey 
(2004a). Including a deadline and a statement of 
the selectivity of the responders in the survey 
invitation were found to be statistically significant 
in improving survey response rates (Porter, & 
Whitcomb, 2005). Personalizing the invitation to 
participate in the survey and frequent reminders 
significantly impacted the response rate as Muhoz- 
Leiva et al. reported from their study (2010). 
However, one study based on 1,598 selected 
students indicated that neither the degree of 
personalization nor the length of the invitation 
email impacted survey response or completion 
(Trespalacios & Perkins, 2016). 

The use of pre-notification and reminders was 
demonstrated to be another significant element in 
survey response rate (Bosnjak, Neubarth, Bandille, 
& Kaczmire, 2008; Fox, Schwartz, & Hart, 2006; 
Kaplowitz, Hadlock, & Levine, 2004; Porter, 
2004b; Spruyt & Van Droogenbroeck, 2014; 
Trouteaud, 2004; Veen, Goritz, & Sattler, 2016). 
For an example in a recent study, the response rate 
increased from 22.6% to 39.4% in their study after 
the reminders were sent (Aerny-Perreten, 
Dominguez-Berjon, Esteban-Vasallo, & Garcia- 
Riolobos, 2015). Yet, scholars have advised against 
sending more than three to four reminders 
(Munoz-Leiva, Sanchez-Fernandez, Montoro-Rios, 
& Ibanez-Zapata, 2010; Van Mol, 2017). Based on 
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a sample of 15,651 students in Belgium, Van Mol’s 
(2017) study found that the effects of over- 
surveying have resulted in a decline in the overall 
response rate. 

Research has also found that pre-paid 
incentives increased response rates (Mercer, 
Caporaso, Cantor, & Townsend, 2015; Porter, 
2004a) while post-paid incentives had no 
influence on response rates (Goritz, 2006; Porter, 
& Whitcomb, 2003). The amount of incentives, 
however, did not show a clear, significant effect on 
survey response rates (Bosnjak, & Tutem, 2003; 
Dykema et al., 2012; Goritz, 2006; Porter, & 
Whitcomb, 2003). Results of another study 
indicated that a mixed-mode survey which 
involves mail and email components has produced 
moderately high response rates. The study also 
found that the mail survey was more effective than 
the email survey (Converse, Wolfe, Huang, & 
Oswald (2008). 

Fan and Yan (2010) asserted that sponsors of 
the survey can affect response rates. They 
maintained that surveys sponsored by academic 
and governmental agencies have higher response 
rate than commercially sponsored surveys, an 
assertion supported by Vance (2011). One study 
indicated that contextual cues (e.g., researcher 
identity, sponsor identity and incentive types) also 
affect response rate of online surveys (Pan, 
Woodside, & Meng, 2013). In their study, a high- 
power position (identity) of the researcher 
generated more responses than one in a lower 
power position (Pan et al, 2013). Magro, Prybutok 
and Ryan (2015) found higher responses among 
student participants using an extra credit 
approach in electronic surveys. In other student 
participant research, Ravert, Gomez-Scott and 
Donnellan (2015) used iPads for an alternative 
electronic survey. Their study did not find any 
significant differences between paper and iPad- 
based survey in terms of acceptance rates and 
proportion of missing data. 


Methods 


Research Questions 


This study was guided by the following research 
questions: 


1. To what extent do factors such as email 
checking habits, attitude towards the 
research, rewards, length of the survey, 
the survey structure, assurance of privacy, 
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and frequency of reminder influence 
survey response rates? 

2. Are demographic factors such as gender or 
age related to participants’ responses to 


survey items? 
Research Design 


A cross-sectional quantitative research method 
was used to analyze the factors that influence 
participants’ email survey response rate. In cross- 
sectional research, data were collected from the 
research participants at a single point in time or 
relatively short time period (Johnson & 
Christensen, 2017). Thus, the researchers did not 
directly measure changes that come over time in 
this study but rather used descriptive statistics 
(percentage, average mean) and _ inferential 
statistics (chi-square and correlations) to report 
the data analysis and findings. 


Participants 


The participants of this study were graduate 
students in education or _ related fields. 
Participants were either masters or doctoral 
students who were American Educational 
Research Association (AERA) graduate student 
discussion listserv members. AERA (2017) 
estimates that 30% (about 7,500) of their 25,000 
members are graduate students. This student 
population was selected based on their active 
engagement in the education research association. 
Furthermore, we also anticipated that graduate 
students will be interested in participating in the 
study because they may be using or considering 
survey methodology in their research papers and 
dissertations. After gaining the approval of 
Institutional Research Board (IRB), the 
participants were invited to take part in the study 
using Survey Monkey, an online survey collection 
tool. We distributed the survey via the listserv. The 
survey took approximately five to seven minutes to 
complete. The participants also received a 
reminder two weeks after the initial survey 
distribution. Data were collected two weeks after 
sending the reminder. The total population of the 
listserv was 575 AERA Graduate Student 
Discussion List subscribers. Statisticians (Gal, Gal, 
& Borg, 2007; Krjcie & Morgan, 1970) recommend 
a sample of 366 for a population of 7,500. With 
454 responses, our sample exceeded this standard 
with a 78.9 % response rate. 
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Table 1 
General Perceptions of Participants Related to Survey Response Factors (N = 454) 
Category Item Agree Disagree Neutral 
Email Checking | open all my emails 40.4% 49.9% 9.7% (44) 
Habit (183) (226) 
| only open emails from people | know 51.6% 14.2% 34.2% 
(233) (64) (155) 
lam more likely to open an email from an organization | 91.2% 5.7% 3.1% 
belong to (413) (26) (14) 
lam more likely to open an email from a non-profit 20.4% 46.9% 32.6% 
organization (93) (213) (148) 
Attitude Toward lam more inclined to complete a research conducted by a 51.5% 37.5% 15% 
Research student (215) (170) (68) 
lam more inclined to complete a research survey if it was 74.1% 17.1% 8.9% 
forwarded by my Chair (334) (77) (40) 
lam more inclined to answer the survey if it is from a 88.7% 8% 3.3% 
colleague | know (399) (36) (15) 
lam more inclined to answer the survey if it is from a 39.2% 34.5% 26.3% 
colleague in the profession whom | do not know (177) (156) (119) 
personally 
Interest lam more inclined to complete the survey if | have a 88.2% 8.4% 2.9% 
vested interest in the topic (389) (37) (13) 
lam more inclined to complete the survey if the author 49% 32% 19.1% 
promised to share the results with me (256) (141) (84) 
lam more likely to fill out academic (educational) surveys 76.3% 18.3% 5.4% 
(338) (81) (24) 
Rewards lam more inclined to complete the survey if promised a 38.4% 27% 34.7% 
monetary reward (169) (119) (153) 
lam more inclined to complete the survey if | received a 37.9% 27.5% 34.6% 
reward with the survey invitation (168) (122) (153) 
Length of Survey lam more inclined to complete the survey if | know how 87.1% 9.3% 3.6% 
long it will take to fill out beforehand (384) (41) (16) 
lam more inclined to complete the survey if it takes less 91.1% 6.8% 2% 
than 15 minutes (391) (30) (9) 
Value Privacy lam more inclined to answer the survey if | am assured of 75% 18.9% 5% 
anonymity (233) (83) (22) 
lam more inclined to complete the survey if | am assured 78.3% 17.6% 4.1% 
that my answers will remain confidential (343) (77) (18) 
Survey Structure lam more likely to open an email with subjects clearly 87.4% 7.7% 4.8% 
indicating the research nature of the content (377) (35) (22) 
lam more likely to fill out the survey if the email invitation 85.1% 11.6% 3.2% 
looked professional (373) (51) (14) 
lam more likely to complete the survey if the questions 94.1% 4.6% 1.3% 
items are short and concise (410) (20) (6) 
lam less likely to finish the survey if it included open- 57% 23.9% 19.1% 
ended questions (248) (104) (83) 
lam more likely to fill out the survey if the email invitation 41.1% 40.3% 18.5% 
includes my name (180) (176) (81) 
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Reminder lam more likely to complete the survey if | receive a 66.6% 20.8% 12.6% 
reminder (289) (91) (55) 
| get bothered if | received more than three reminders 75.3% 16.5% 8.3% 
from the researchers. (328) (72) (36) 
Pre-notification lam more likely to open the email if | Response Count 
received a pre-notification Percent 
a) Byemail 91.8% 370 
b) By mail 8.2% 33 
Survey Time lam more inclined to complete the survey if | received the email Response Count 
Received Percent 
a) At beginning of the day 53.2% 223 
b) During my lunch/break time 13.6% 57 
c) Atthe end of the day 13.4% 56 
d) Inthe evening 19.8% 83 
lam less likely to answer the survey Response Count 
Percentage 
a) During the summer months 14.5% 63 
b) During the holidays 39% 164 
c) Atthe beginning of the school year 20% 84 
d) Toward the end of the school year 26.6% 112 


Survey Instrument 


We developed the survey instrument based on 
existing literature (Dillman, 2007; Fan & Yan, 
2010; Vance, 2011). The instrument included 28 
items of which there were 24 items related to 
electronic survey response (Cronbach’s Alpha = 
.766) and two demographic variables. With the 
exception of the questions eliciting demographic 
information, the instrument utilized a Likert scale 
where 1 = strongly agree and 5 = strongly 
disagree. In reporting the results, the data from 
the two columns of “strongly agree” and “agree” 
were combined and the data for “strongly 
disagree” and “disagree” were combined as well. 
The survey instrument included the following sub- 
group of variables: email checking habit (4 items), 
attitude toward research (4 items), similar 
research interests (3 items), rewards for 
completion (2 items), length of survey (2 items), 
assurance of privacy and confidentiality (2 items), 
survey structure (5 items), survey reminders (2 
items), time survey was received (2 items) and 
demographic information (2 items). 


Results 


A total of 454 participants completed the online 
survey. There were more female (72.4%, 314) than 
male student participants (27.6%, 120). Twenty 
students did not respond to the gender question. 


About half of the total student participants were in 
the age group of 31-45 years (44.1%), whereas a 
quarter of participants were either younger than 
30 years or between 46 to 60 years. There were 31 
(7.1%) participants who identified themselves as 
older than 60 years. 

Participants reported a variety of email 
checking habits (Table 1). The majority of 
participants reported that they only open emails 
from the people they know or emails from the 
organization for which they work. Almost half the 
participants (49.9%) reported that they do not 
open all emails they receive. Participants also 
showed a higher percentage of positive response 
(51.5% or more) to the questions related to their 
attitude toward research. Participants indicated 
that they were willing to complete a research 
survey conducted by a student (51.5%), received 
from the department chair (74.1%) or sent by 
known colleagues (88.7%). About 40% of 
participants reported that they were willing to 
complete the survey if it was sent from a colleague 
whom they do not know personally. 

Results also indicated that the survey response 
rate was highly related to research interests of 
participants, rewards associated with survey 
completion,; length of survey; and assurance of 
privacy and confidentiality. When asked, 88.2% of 
participants agreed that they were more inclined 
to complete the survey if they have a vested 
interest in the topic; 76.3% of participants 
indicated that they will complete a survey if it was 
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educational or academic in nature. About 91.1% 
participants agreed that they would complete the 
survey if it takes less than 15 minutes to complete. 
More than three quarters of participants (78.3%) 
agreed that the researchers should assure them of 
the anonymity and_ confidentiality of the 
information they share in the survey (see Table 1). 
Only 38% of participants indicated that a 
monetary reward was expected when they 
participate in the survey. 

Results indicated three important factors 
necessary in order to receive a high response rate. 
These factors were: pre-notification sent by email 
(91.8%); survey structure -an email with a clear 
research subject heading (87.4%); professional 
email invitation (85.1%); short and _ concise 
question items (94.1%); few or no open-ended 
questions (57%); and a reminder (66.6%). 
Participants were asked for the time of day they 
were more likely to complete the survey. Over 53% 
of them replied that they would complete it if 
received at the beginning of the day. They also 
indicated that they were less likely to complete a 
survey if they received it during holidays (39%), 
summer (14.5%), beginning of the school year 
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(20%), or toward the end of the school year 
(26.6%). 

Pearson Chi-square results indicated that male 
participants were significantly different from 
females on whether they were likely to complete 
the survey if they received a reminder (X2 = 7.86, 
df = 2, N = 454, p = .020), and if the 
questions/statements were short and concise (X? = 
7.68, df = 2, N = 454, p = .022). In other words, 
males were more likely to complete the survey 
after a reminder than females. Similarly, males 
were more likely than females to complete the 
survey if the questions were short and precise. 
However, males and females were not significantly 
different on whether they were likely to open the 
survey email if they received a pre-notification by 
email or by mail (X2 = .002, df = 1, N = 454, p = 
.964). Phi, which indicated the strength of the 
association between two variables, was -.002. 
Similarly, male and female participants were not 
significantly different on whether they would 
complete a survey if they had a vested interest in 
the research topic (X2 = .257, df = 2, N = 454, p = 
.879). The strength of the association between 
variables had a smaller size effect of .135 or less. 


Table 2. 
Chi-Square Analysis of Prevalence of Survey Response Factors Among Males and Females 


‘ Gender , 
Variable N x P 
Male Female 
Iam more likely to open the survey 002 964 
email if I received a pre-notification 
By email 364 101 263 
By mail 32 9 23 
I am more likely to complete the survey 7.86 020 
if I receive a reminder ; i 
Agree 289 71 218 
Neutral 89 25 64 
Disagree 56 24 32 
I am more likely to complete the survey 
if the question items are short and 7.68 022 
concise 
Agree 406 106 300 
Neutral 19 10 9 
Disagree 9 4 5 
I am inclined to complete the survey 257 879 
if I had a vested interest in the topic ; ; 
Agree 378 103 275 
Neutral 37 11 26 
Disagree 19 6 13 


Our correlational analysis indicated that the 
age of participants was positively correlated with 
rewards, r (435) = .22, p < .001. However, age was 
not statistically correlated with participants’ email 
checking habits, attitude toward research, length 
of survey, privacy assurance, survey structure, and 
the number of reminders. Further analysis 
indicated that younger participants, age 20-30, 
were less interested in rewards than older 
participants, age 40-60 or older. 


Discussion 


Even though e-mail contact is the fastest, lowest- 
cost method to deliver surveys, the use of anti- 
spamming software and the wide use of 
unsolicited email made the response rate of email 
surveys lower than mail or phone surveys (Couper, 
Kapteyn, Schonlau, & Winter, 2007; Petrovéié et 
al., 2016; Vance, 2011; Veen et al., 2016). In the 
1990s, email surveys were a promising method to 
gain a better response rate on research surveys. 
Munoz-Leiva, et al. (2010) reported that the 
response rate for email surveys was above 50% in 
the early 1990s due to the novelty of email, but 
now this percentage had declined greatly due to 
the wide use of filters and survey fatigue. Sheehan 
(2001) pointed out that research on email surveys 
offer little information on research design and 
methodology. Porter (2004b) stated that it is vital 
for researchers to understand the reasons people 
respond to surveys. 

The results of this study suggest that 
participants prefer completing electronic surveys 
received mostly from students, colleagues and 
authority figures (e.g. department chair or higher) 
compared to people from other organizations who 
they do not know personally or professionally. 
These results support earlier findings by Fan and 
Yan (2010), Pan et al. (2013), Porter (2004b) and 
Trespalacios & Perkins (2016). One of the 
implications of these results may be that 
researchers should target specific groups or elicit 
the aid of authority figures in the field of the target 
population, for example, a department chair or 
CEO of an organization. Researchers can also 
enlist the help of major organizations to distribute 
the surveys through their listserv. 

Results also indicated that the survey response 
rate was highly related to the research interests of 
participants. The results are in agreement with the 
findings of Dillman (2007) and Porter and 
Whitcomb (2005). Over 88% of participants 
indicated that they will be more likely to complete 
a survey if they are interested in the topic. 
Therefore, researchers need to target populations 
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that are more likely to be interested in the research 
focus to increase the response rate for their 
surveys (Petrovéié et al., 2016). In this study, we 
targeted graduate students involved in educational 
research assuming that they will be interested in 
the results. This could be the reason that the 
response rate for this survey was 78.9%. 

Past studies asserted that shorter surveys have 
higher response rate (Liu & Wronski, 2017; Porter, 
2004a). Similarly, about 91.1% participants in this 
study agreed that they would complete the survey 
if it takes less than 15 minutes to complete. 
Researchers need to be mindful of the time it takes 
to complete their survey and attempt to shorten 
their survey, when possible, to motivate 
respondents to complete it. There is also a need to 
inform the participants in the invitation letter of 
the approximate time it will take to complete the 
survey. In the current study, we informed the 
participants that it will take approximately 5-7 
minutes to complete. 

More than three quarters of participants 
(78.3%) reported that the study should assure 
anonymity and confidentiality for the information 
they share with researchers in the survey. The 
results of the study indicated important factors 
necessary to receive a high response rate: pre- 
notification sent by email (91.8%); survey 
structure (an email with a clear research subject 
heading (87.4%); professional email invitation 
(85.1%); short and concise question items (94.1%); 
and few or no open-ended questions (57%); and a 
reminder (66.6%). These findings supported 
earlier findings (Aerny-Perreten et al., 2015; 
Crawford, McCabe, & Pope, 2005; Dillman, & 
Smyth, 2007; Greer, Chuchinprakarn, & Seshadri, 
2000; Spruyt & Van Droogenbroeck, 2014; Van 
Mol, 2017). Therefore, it is suggested for 
researchers to consider these factors as they design 
their online surveys and research methods. 

Greer, Chuchinprakarn, and Seshadri (2000) 
found the day of the week the survey was sent not 
to be an influential factor in response rate. In this 
study, over 53% of the respondents indicated that 
they are more likely to complete the survey if they 
received it at the beginning of the day. The results 
of this study indicated that the time of the year 
may have an effect on the response rate for 
surveys. Almost 40 % of participants agreed that 
they are less likely to answer the survey during the 
holidays. Others indicated that they are less likely 
to answer the survey during the summer months 
(14.5%), at the beginning (20%) or end of the 
school year (26.6%). The results are in agreement 
with Vance’s (2011) contention that seasonality 
affects survey response rate and that it differs with 
each target group. The results of this study reflect 
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the times where graduate students are either on 
vacation or involved in their studies. These results 
suggest that future researchers have to be 
cognizant of the effect of timing on research survey 
response rates. Researchers should choose a time 
during the year that is most conducive for their 
target population. 

Additionally, male participants were 
significantly different from females in other parts 
of the study. Males were more likely to complete 
the survey if they received a reminder, and if the 
questions items were short and concise. Results 
also indicated that rewards offered in the survey 
correlate positively with age. In other words, the 
older the participants, the higher the response rate 
if a reward is promised. The results agree with the 
findings of previous studies (Couper, Conrad, & 
Tourangeau, 2007; Yan & Fan, 2010) that some 
demographic variables such as age and race affect 
participants’ willingness to complete the surveys. 

We contend the survey response rate depends 
on a combination of factors including reward, trust 
and costs, which affect the likelihood that 
individuals will respond to the surveys. This 
contention is supported by Dillman’s (2007) social 
exchange theory. He argued that human behavior 
is motivated by the response they expect to elicit. A 
major limitation to the study is that only graduate 
students of education were included. This group of 
students may not represent the general population 
of education graduate students because they are 
listed on the AERA listserv, which indicate that 
they are more involved in educational research 
than others. Therefore, the results cannot be 
generalized for the whole population of graduate 
students of education, nor it can be generalized for 
the general population. 


Recommendations 


This study offers some insights regarding the use 
of online surveys and response rates. It may 
prevent many researchers from becoming 
disappointed from the dismal response rates for 
their surveys. As Porter and Whitcomb (2005) 
described, low response rate in online survey 
research is an increasing phenomenon, which 
needs to be addressed. In the current study, we 
examined the factors that influence education 
graduate students’ responses to online surveys. 
Based on responses of participants in this study, 
we suggest that future researchers may consider 
the following practices when designing their 
surveys and invitation letters to research target 
populations in order to increase their response 
rates. Researchers are recommended to : 
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1. Elicit the aid of authority figures, known 
personnel or organizations to the target 
population to distribute the survey, when 
possible. 

2. Target a population that is more likely to 
hold interest in the research. 

3. Consider offering an incentive for 
completing the survey. 

4. Make every effort to craft a survey that is 
short and concise. 

5. Inform the population in the invitation 
letter of the approximate time it will take 
to complete the survey. 

6. Whenever possible, reduce the number or 
eliminate open-ended survey items. 

7. Assure the participants of the anonymity 
and confidentiality of their responses. 

8. Explain how the collected data will be 
handled, who will have access to them, 
and how the data will be stored and/or 
disposed of after the study is completed. 

9. Personalize invitations to participate in 
the study and make them _ look 
professional. 

10. Send at least one, but not more than three, 
reminders to the target population to 
motivate them to complete the survey. 

11. Be aware of the time constraints related to 
time-of-year for the target population. 


This study offers insights as to why education 
graduate students were interested in responding 
or not responding to online surveys. In the case of 
this study, graduate students in the field of 
education served as a purposeful, albeit narrow, 
sample. However, this sample is not free from 
limitations. One limitation is that the graduate 
student listserv is opt-in for graduate students, 
meaning that only a particular subsection of 
AERA-affiliated graduate students will receive 
emails sent to that listserv. Instead, these 
inferences are really about how those who respond 
to research invitations rated their own likelihood 
to respond. We suggest the future research could 
focus on reasons why many research survey 
invitations remain unanswered. Similar research 
needs to target different populations with different 
interests, fields or occupations as well as other 
countries. Future research should examine other 
demographic elements such as race, ethnicity, 
degree of education, and personality of the 
participants. The model and recommendations 
may help future researchers, but they should not 
be generalized to all populations until similar 
studies are conducted with different populations 
and findings of such studies are supported. 
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